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Administrivia 

• Problem set 1: 

• How did it go? 

• What would have made it better? 

• New problem set will be out by tonight or tomorrow, due 
Monday, Sept 22 nd , 11:55pm 

• Today: Camera models and cameras 

• FP Chapter 1 and 2. 1-2. 2 
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What is an image? 

■ Up until now: a function - a 2D pattern of intensity values 

■ Today: a 2D projection of 3D points 



Figure from US Navy Manual of Basic Optics and Optical 
Instruments, prepared by Bureau of Naval Personnel. Reprinted 
by Dover Publications, Inc., 1969. 
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First Known Photograph 

View from the Window at le Gras, 


Joseph Nicephore Niepce 1826 Reproduction, 1952 



Heliograph- a pewter plate coated with bitumen of Judea (an asphalt derivative of 
petroleum); after at least a day-long exposure of eight hours, the plate was removed and 
the latent image of the view from the window was rendered visible by washing it with a 
mixture of oil of lavender and white petroleum which dissolved away the parts of the 
bitumen which had not been hardened by light. - Harry Ransom Center UT Austin 
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What is a camera/imaging system? 

• Some device that allows the projection of light from 3D 
points to some “medium” that will record the light pattern. 

• A key to this is “projection”... 
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Projection 
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Image formation 

object 



• Let’s design a camera 

• Idea 1: put a piece of film in front of an object 

• Do we get a reasonable image? 
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Pinhole camera 


object barrier film 



• Add a barrier to block off most of the rays 

• This reduces blurring 

• The opening known as the aperture 

• How does this transform the image? 
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Camera Obscura (Latin: Darkened Room) 



• Known to Aristotle (384-322 BCE) 

• According to DaVinci “When images of illuminated objects ... 
penetrate through a small hole into a very dark room ... you will 
see [on the opposite wall] these objects in their proper form and 
color, reduced in size, in a reversed position, owing to the 
intersection of the rays". 

• Depth of the room is the “focal length” 

• How does the aperture size affect the image? 
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Home-made pinhole camera 



Why so 
blurry? 


http://www.debevec.org/Pinhole/ 
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Shrinking the aperture 
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• Why not make the aperture as small as possible? 

• Less light gets through 

• Diffraction effects... 
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Shrinking the aperture 
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Adding a lens - and concept of focus 



• A lens focuses light onto the film 

• There is a specific distance at which objects are “in focus” 

• other points project to a “circle of confusion” in the image 

• Changing the shape of the lens changes this distance 
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• A lens focuses parallel rays onto a single focal point 

• focal point at a distance f beyond the plane of the lens 

• f is a function of the shape and index of refraction of the lens 

• Aperture of diameter D restricts the range of rays 

• aperture may be on either side of the lens 

• Lenses used to be typically spherical (easier to produce) but now 
many “aspherical” elements - designed to improve variety of 
“aberrations”. 
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Thin lenses 



Thin lens model assumes thickness is small compared to 
curvature: 

1. Any ray parallel to the axis on one side of the lens passes through 
the focal point on the other side. 

2. Any ray that passes through the center of the lens will not change 
its direction. 

This gives rise to the “thin lens equation”... 


Slide by Steve Seitz 
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The thin lens equation 



Computer Vision - A Modern Approach 

Set: Cameras 

Slides by D.A. Forsyth 
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The thin lens equation 
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The thin lens equation 
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The thin lens equation 



Thin lens equation 
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What’s in focus and what’s not? 



• A lens focuses light onto the film 

• There is a specific distance at which objects are “in focus” 

• other points project to a “circle of confusion” in the image 

• Changing the shape or relative locations of the lens elements 
changes this distance 
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Varying Focus 



Ren Ng 
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f/ 32 

• Changing the aperture size affects depth of field 

• A smaller aperture increases the range in which the object is 
approximately in focus 

• Aside: could actually compute distance from defocus 

• But small aperture reduces amount of light - need to increase 
exposure 


Flower images from Wikipedia http://en.wikiDedia.org/wiki/Depth of field 
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Large apeture = small DOF 


Camera Model 



Small apeture = large DOF 
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Nice Depth of Field effect 
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Field of View (Zoom) 
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From London and Upton 
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Field of View (Zoom) 





e 


From London and Upton 
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FOV depends on Focal Length 



Larger Focal Length => Smaller FOV 



CS 4495 Computer Vision - A. Bobick 


Camera Model 


Zooming and Moving are not the same.. 
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Field of View / Focal Length 



Large FOV, small f 
Camera close to car 




Small FOV, large f 
Camera far from the car 





CS 4495 Computer Vision - A. Bobick 


Camera Model 


Perspective and Portraits 
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Perspective and Portraits 
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Effect of focal length on perspective effect 





perspective 


weak perspective 


increasing focal length 



increasing distance from camera 



From Zisserman & Hartley 
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Dolly Zoom 



• Move camera while zooming, keeping foreground 
stationary 

• Pioneered by Hitchcock in Vertigo (1958) 

• Oriqina KYouTube link) (2:07) 


An Actual Slide by Jim Rehg 
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Dolly Zoom - Hitchcock’s Vertigo 


0 
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Dolly Zoom - “anyone can do it” 


e 
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But reality can be a problem. . . 

• Lenses are not thin 

• Lenses are not perfect 

• Sensing arrays are almost perfect 

• Photographers are not perfect - except some of us... 



CS 4495 Computer Vision - A. Bobick 


Camera Model 


Geometric Distortion 
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No distortion Pin cushion 



Barrel 


• Radial distortion of the image 

• Caused by imperfect lenses 

• Deviations are most noticeable for rays that pass through the edge 
of the lens 
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Modeling geometric distortion 


Assume project^, y, z) 

x' 

= xjz 

to “normalized” 

Vn 

image coordinates 

II 

<cS> 


r 2 

_ / 2 . / 2 

% n "T" yn 

Apply radial distortion 

x 'd 

— x' n (l + Kir 2 + K 2 r 4 ) 


yd 

= y'rSX + K l r ' 2 + K 2 r4 ) 

Apply focal length 

x f 

= fx' d + x c 

translate image center 

y f 

= fy'd + yc 


• To model lens distortion 

• Use above projection operation instead of standard projection 
matrix multiplication (which you haven’t seen yet!) 
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Correcting radial distortion 






from Helmut Dersch 
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Chromatic Aberration 


Rays of different wavelength 
focus in different planes 



A>dal chromatic aderration Magnification chromatic aderration 



Can be significantly improved by 
"undistorting" each channel 
separately 
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Vignetting 



Some light misses the lens or is otherwise blocked by parts 
of the lens 
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Lens systems 

Nikon 24-70mm zoom 



[□]: Nano Crystal Coat [ j: Aspherical lens elements 

Q: ED glass elements 


• Real lenses combat these effects with multiple elements. 

• Computer modeling has made lenses lighter and better. 

• Special glass, aspherical elements, etc. 
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Retreat to academia!!! 

• We will assume a pinhole model 

• No distortion (yet) 

• No aberrations 
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Modeling projection 

• We will use the pin-hole model 
as an approximation 

• Put the optical center (Center Of 
Projection) at the origin 

• STANDARD (x,y) 

COORDINATE SYSTEM 

• Put the image plane (Projection 
Plane) in front of the COP 

• Why? 

• The camera looks down the 
negative z axis 

• we need this if we want right- 
handed-coordinates 


Camera Model 


coordinate syste 
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Modeling projection 

• Projection equations 

• Compute intersection with 
Perspective Projection of ray 
from (x,y,z) to COP 

• Derived using similar triangles 


(x, y, z) (— d — , — d — , —d) 

z z 

• We get the projection by 
throwing out the last 
coordinate: 

KX,y,z) (-d-, -d-) 

z z 
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Distant objects 
are smaller 
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Distant objects appear smaller 
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Homogeneous coordinates 

• Is this a linear transformation? 

• No - division by Z is non-linear 

Trick: add one more coordinate: 





X 


X 


y 

z 

(x,y) => 


(x,y,z) =^> 




1 


homogeneous image (2D) homogeneous scene (3D) 
coordinates coordinates 


Converting from homogeneous coordinates 


l_ — 1 


X 

X 


y 

z 

y 

=> (x/w 1 y/w ) 

w 


*— — 1 


w 


=>- ( x/ w, y / w, z/w ) 


Homogenous coordinates invariant under scale 
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Perspective Projection 

• Projection is a matrix multiply using homogeneous 
coordinates: 

“10 0 
0 10 
0 0 1 If 

This is known as perspective projection 

• The matrix is the projection matrix 

• The matrix is only defined up to a scale 

• f is for “focal length - used to be d 
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S. Seitz 
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Perspective Projection 

• How does scaling the projection matrix change the transformation? 


10 0 0 

0 10 0 
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S. Seitz 
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Geometric properties of projection 

• Points go to points 



• Degenerate cases: 

• line in the world through focal point yields point 

• plane through focal point yields line 



CS 4495 Computer Vision - A. Bobick 


Camera Model 



Parallel lines in the world meet in the image 

• “Vanishing” point 
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Parallel lines converge in math too... 


Line in 3-space 

x(t) = x 0 +at 

yd) = y 0 +bt 

z(t) = z 0 +ct 


Perspective projection of the line 

x'(t) = 


f(x o + at) 

Z 

z 0 + ct 

y'(t) = 

fy _ 

f(y« + bt) 


z 

z 0 + ct 


In the limit as t — » ±oo 
we have (for c ^ 0 ): 



fa 

c 



t 

c 


This tells us that any set of parallel lines (same a, b, 
c parameters) project to the same point (called the 
vanishing point). What does it mean if c=0? 
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Vanishing points 

• Each set of parallel lines 
(=direction) meets at a 
different point 

• The vanishing point for this 
direction 

• Sets of parallel lines on the 
same plane lead to 
collinear vanishing points. 

• The line is called the horizon 
for that plane 


Camera Model 



Good ways to spot faked 

images 

• scale and perspective don’t 
work 

• vanishing points behave 
badly 

• supermarket tabloids are a 
great source. 
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Vanishing points 



Different directions correspond 
to different vanishing points 
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Human vision: Muller-Lyer Illusion 



http://www.michaelbach.de/ot/sze muelue/index.html 
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Other projection models 
projection 



Camera Model 


Orthographic 
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Orthographic projection 

• Special case of perspective projection 

• Distance from the COP to the PP is infinite 



• Good approximation for telephoto optics 

• Also called “parallel projection”: (x, y, z) — > (x, y) 

• What’s the projection matrix? 
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Other projection models: Weak perspective 


• Issue 

• Perspective effects, but 
not over the scale of 
individual objects 

• Collect points into a group 
at about the same depth, 
then divide each point by 
the depth of its group 

• Adv: easy 

• Disadv: only approximate 
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Three camera projections 


3-d point 2-d image position 


(1) Perspective: 

(2) Weak perspective: 

(3) Orthographic: 
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